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Abstract 

The maximum multicommodity flow problem is a natural generalization of the maximum flow prob- 
lem to route multiple distinct flows. Obtaining a 1 — e approximation to the multicommodity flow 
problem on graphs is a well-studied problem. In this paper we present an adaptation of recent advances 
in single-commodity flow algorithms to this problem. As the underlying linear systems in the electrical 
problems of multicommodity flow problems are no longer Laplacians, our approach is tailored to gen- 
erate specialized systems which can be preconditioned and solved efficiently using Laplacians. Given 
an undirected graph with m edges and k commodities, we give algorithms that find 1 — e approximate 
solutions to the maximum concurrent flow problem in time O(m 4 / 3 poly(fc, e^ 1 )). 
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1 Introduction 



The multicommodity flow problem is a natural extension of the maximum flow problem to routing multiple 
demands simultaneously in a network subject to capacity constraints. To date, all of the (almost) exact 
algorithms for multicommodity flow problems involve solving a linear programming formulation. The 
method with the best asymptotic behavior for this case is the interior point algorithm, which requires 



product involving the inverse in each iteration. 

An alternate approach to solving linear systems introduced by Vaidya a few years later has led to a 
possible way to circumvent this problem. The graph-like nature of the underlying linear system, graph 
Laplacians, allows one to find sparse approximations of it, which, when used to precondition iterative 
solvers, led to speedups in solving such systems [Vai91]. This approach using graph Laplacians has been 
extended greatly in subsequent works, leading to algorithms with nearly-linear running times [ST06]. 

From the perspective of combinatorial optimization, graph Laplacians are closely connected with prob- 
lems involving a single kind of flows, such as maximum flow, minimum cost flows and shortest path. To 
the best of our knowledge it was first observed in [DS08] that the class of linear systems obtained by 
running interior point algorithm on these problems are Laplacians. However, most of the preconditioning 
machinery relies on the system being composed by 2-by-2 blocks corresponding to single edges. In the 
case of multicommodity flows, a constraint corresponding to the sum of k flows nearly saturating an edge 
results in a larger k-by-k block. This issue is quite similar to the ones encountered when trying to solve 
systems arising from stiffness matrices of finite element systems [BHV04, AT11]. 

Subsequent work on multicommodity flow focused on obtaining 1 + e approximate solutions in faster 
time. These work initially focused on the case of small k, and the algorithms are based on solving multiple 
minimum cost flow problems [LMP + 91]. When combined with the minimum cost flow algorithm from 
[DS08], these algorithms gave a running time of 0(m L5 poly(/c, e" 1 )). 

More recent studies have applied the multiplicative weights update method using single source shortest 
path routines as oracles [GK98, FleOO]. The most recent among these approaches obtained a running time 
of 0(nm/e 2 ) using dynamic graph data structures [MadlO]. When applied to instances with a smaller 
value of k however, these approaches encounter similar issues to those encountered by path based single- 
commodity flow algorithms: the flow decomposition barrier of Q(nm). As a result, minimum cost flow 
based oracles gives better performance the case where k is small. 

Recently, the running time for approximate maximum flow has been improved to 0(m 4 / 3 ) [CKM+11]. 
A natural question arising from this is whether their algorithm also extends to minimum cost flow, or 
multicommodity flow. The main difficulty of using decoupled electrical energies for multicommodity flow 
can perhaps be illustrated by the following example. Suppose k = 2 and the energy function is + f| on an 
edge with capacity 1, then the flow of (1,0), (0, 1), and (y/2/2, y/2/2) all have energy 1, despite the last one 
having congestion \J2. In general this type of approach where no coupling between flows are tracked leads 
to some edges being over-congested by a factor of y/k. We deal with this problem by introducing energy 
terms of the form (fi + fb) 2 , but this in turn results in the underlying matrix no longer being a Laplacian. 
A more careful analysis allows us to control the condition number of preconditioning such matrices with 
Laplacians via another outer loop and bring us back into the electrical flow framework. On a graph with 
m edges and k commodities, our algorithm computes an 1 — e approximate maximum concurrent flow in 
time O(m 4 / 3 poly(fc, e -1 )). An overview of the main steps of the algorithm is shown in Section 3. 
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2 Preliminaries 

2.1 Maximum Concurrent Multicommodity Flows 

The maximum concurrent multicommodity problem concerns the simultaneous routing of various com- 
modities in a capacitated network. For our purposes, the graph is an undirected, capacitated graph 
G = (V, E, u) where u : E — > R + is the capacity of each edge. If we assign an arbitrary orientation to the 
edges, we can denote the edge-vertex incidence matrix B G sft mxn as: 



B(e,u) 



1 if u is the head of e 
—1 if u is the tail of e 
otherwise 



(2.1) 



Then, for a (single commodity) flow f, the excess of the flow at each vertex is given by the length n vector 
B T f. 

Throughout the paper we let k be the number of commodities routed. It can be shown that it suffices 
to solve the fc-commodity flow problem for fixed vertex demands di, d2 . . . one for each commodity. 
The goal of finding a flow that concurrently routes these demands in turn becomes finding fj for each 
commodity such that: 



B T fi = di (2.2) 

The other requirement for a valid flow is that the flows cannot exceed the capacity of an edge. Specif- 
ically we need the following constraint for each edge e: 



l<i<fc 

2.2 Notations for fc-Commodity Flow and Vertex Potentials 

The extension of a single variable indicating flow/vertex potential on an edge/vertex to k variables creates 
several notational issues. We use a length km vector f £ !Jt fcm to denote a k-commodity flow, and allow for 
two ways to index into it based on commodity /edge respectively. Specifically, for a commodity i, we use 
fj to denote the length m vector with the flows of commodity % along all edges and for an edge e, we use 
f(e) to denote the length k vector containing the flows of all k commodities along this edge. 

This definition extends naturally to vectors over all (vertex, commodity) pairs as well. We let d G 3ft nfc 
be the column vector obtained by concatenating the length k demand vector over all n vertices. If the 
edges are labeled e\ . . . e m and the vertices v i . . . v n , then f and d can be written as: 



f r = [f( ei ) T ,f(e 2 ) r ,...,f(e m f] (2.4) 
d T = [d( Vl ) T ,i(v 2 ) T ,...,d(v n ) T ] (2.5) 

We can also define larger matrices that allows us to express these conditions across all k commodities, 
and their interactions more clearly. The edge-vertex incidence matrix that maps between d and f is the 
Kronecker product between B and the k x k identity matrix 
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r =b ® i k 

and f meeting the demands can be written as: 



(2.6) 



r T f = d (2.7) 

Note that flows of two commodities passing in opposite directions through the edge do not cancel each 
other out. 

By obtaining crude bounds on the flow value using bottle neck shortest paths and binary searching in 
the same way as in [CKM + 11], the maximum concurrent multicommodity flow problem can be reduced to 
O(logra) iterations of checking whether there is a /c-commodity flow f that satisfies the following: 



k 

w)\\i=T.\^ e )\^< e ) yeeE 
i=i 

rf =d 

2.3 Multicommodity Quadratically Coupled Flows 

We define two generalizations of electrical flows to multiple commodities. Our main goal is to capture 
situations where the amount of flows of one type allowed on an edge depends inversely on the amount of 
another flow, so the flows are "coupled." To do so, we introduce a positive-definite, block-diagonal matrix 
p £ sftfcmxfcm guch that p = ^ e p( e ) an d each P(e) is a k x k positive definite matrix defined over the k 
entries corresponding to the flow values on edge e. 

For each edge the k flows along an edge e, f(e) we get a natural quadratic penalty or energy dissipation 
term: 

£ f (P,e) = f(e) T P(e)f(e) (2.8) 
Summing these gives the total energy dissipation of a set of flows, denoted using E. 



£ f (P)=J>(P,e) 

e 

=f T Pf (2.9) 

In the Quadratically Coupled Flow problem, we aim to find a flow f that satisfies all of the demand 
constraints and minimizes the total energy dissipation, namely: 



min £ f (P) (2.10) 
subject to: T T f=d (2.11) 

The minimum is denoted by £(P). We can define the related potential assignment problem, where 
the goal is to assign potentials to the vertices to separate the demands. Note that due to there being k 
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commodities, a potential can be assigned to each (flow, vertex) pair, creating <ft E K fen . This vector can 
also be viewed as being composed of n length k vectors, with the vector at vertex u being 4>(u). Given an 
edge e = (u, v ) whose end points connects vertices with potentials 4>(u) and 4>(v), the difference between its 
end points is 4>(u) — (fi(v). In order to map this length nk vector into the same support as the k-commodity 
flows along edges, we need to multiply it by T, and we denote the resulting vector as y: 

y=I> (2.12) 
The energy dissipation of an edge with respect to (ft can in turn be defined as: 

£ 4> (P,e)=yP(ey 1 y (2.13) 

Note that this definition relies on P(e) being positive definite and therefore invertible on the support 
corresponding to edge e. This can in turn be extended analogously to the energy dissipation of a set of 
potentials as: 

^(P)=^^(P,e) 

e 

=^ T r' r p- 1 r^ (2.14) 

We further generalize the definition of a Laplacian to k commodities: 



£ = r T p _1 r (2.15) 

Thus, the energy dissipation of a set of potentials also equals to 4> T £cf). Which leads to the following 
maximization problem, which is the dual of the quadratically coupled flow problem. 



max {d T (t)f (2.16) 
subject to: £^(P) < 1 (2.17) 

We denote the optimum of this value using C e //(P) and will show in Section 4.1 that C e //(P) = £■ (P). 
Another coupled flow problem that's closer to the maximum concurrent flow problem is one where we 
also bound the saturation of them w.r.t. P, where saturation is the square root of the energy dissipation. 



saturation f (P,e) = x/f(e) T P(e)f(e) (2.18) 

Finding a flow with bounded saturation per edge will be then called the Quadratically Capacitated 
Flow problem. 

3 Overview of Our Approach 

A commonality of the algorithms for flow with Laplacian solves as inner loop [DS08, CKM + 11] is that they 
make repeated computations of an optimum electrical flow in a graph with adjusted edge weights. The 
main problem with extending these methods to /c-commodity flow is that the Laplacian for /c-commodity 
electrical flow C is no longer symmetrically diagonally dominant. Our key observation in resolving this 
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issue is that when the energy matrices P(e) are well-conditioned, we can precondition P with a diagonal 
matrix. Then using techniques similar to those in [BHV04] , we can solve systems involving C using a small 
number of Laplacian linear system solves. Our algorithm for ^-commodity flow has the following layers 
with a description in Figure 1 as well. 

1. We adapt the algorithm from [LMP+91] to use flows with electrical capacity constraints associated 
with the k commodities instead of minimum cost flow as its oracle call. At the outermost level, the 
approximately multi-commodity flow algorithm, repeatedly computes a positive definite matrix P(e) 
for each edge based on the flows on it so far on that edge, and boost their diagonal entries to keep 
their condition number at most poly(fe). The outermost level then calls an algorithm that computes 
quadratically capacitated flow that is: 



saturationj(P, e) < max saturatiorif(P, e) (3.19) 

f,||f(e)||i<u(e) 

After repeating this process poly(fc) times, averaging these flows gives one where ||f(e)||i < (l+e)u(e) 
on all edges. We give two methods for computing P in Section 6 and 7. 

2. We use an algorithm that's a direct extension of the electrical flow based maximum flow algorithm 
from [CKM + 11] to minimize the maximum saturation of an edge. This stage of the algorithm in turn 
solves 0{m 1 ^) quadratically coupled flows where the energy coupling on an edge is P(e) = w e P(e). 
Note that since P(e) was chosen to be well conditioned and w e is a scalar, the P(e)s that we pass 
onto the next layer on remains well-conditioned. This is presented in Section 5. 

3. In turn the Quadratically Capacitated Flow Algorithm makes calls to an algorithm that computes 
a quadratically coupled flow. The almost-optimal quadratically coupled flow is obtained by linear 
solves involving C Specifically, we show that preconditioning each P(e) with a diagonal matrix 
allows us to decouple the A:-flows, at the cost of a mild condition number set in the outermost layer. 
Then using preconditioned Chebyshev iteration, we obtain an almost optimal quadratically coupled 
flow using poly(/c,e~ 1 ) Laplacian solves on a matrix with m non-zero entries. Properties of the 
/c-commodity electrical flow, as well as bounds on the error and convergence of the solves are shown 
in Section 4. 

4 Approximate Computation of Multicommodity Electrical Flows 

4.1 Relation Between Multicommodity Electrical Flow and Effective Resistance 

Let x be the vector such that £x = d. It can be shown that £(P,<p) is maximized when (f> is a multiple of 
x. Then the scaling quantity A as well as the optimum set of potential 4> are: 



A =Vd T £+d (4.20) 
0=ix 

=ir + d (4.2i) 

A 

Note that d satisfies ljd = for all 1 < % < k. Also, since P is positive-semidefinite, the null space of 
C is precisely the space spanned by the k vectors lj. Therefore d lies completely within the column space 
of C and we have CC + d = d. The value of d T d> is then: 
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MaxConcurrentFlow 

Constraint on desired flow: For each e, total flow \ f e \ < 1. 

Repeatedly updates energy matrices using matrix multiplicative weights. Makes poly(fc) oracle calls 
to: 

QuadraticCapacitatedFlow 

Constraint on desired flow: For each e, saturation f (P, e) = ^f(e) T P(e)f(e) < 1. 
Repeatedly updates energy matrices using (scalar) multiplicative weights. Makes 0(m 1//3 ) oracle 
calls to: 

QuadraticCoupledFlow 

Constraint on desired flow: Minimize total dissipated energy £f(P) = ^ e f(e) T P(e)f(e). 
Solves 1 linear system using: 
PreconCheby 

Solves non-Laplacian system by preconditioning with k n x n Laplacians. Solves these 
using k calls to nearly- linear time Laplacian solvers. 



Figure 1: The high-level structure of the algorithm and the approximate number of calls made to each 
routine (for fixed e). 



d T <p =d T =£+d 
A 

=A (4.22) 
The optimal quadratically coupled flow can be obtained from the optimal vertex potentials as follows: 

f=p- 1 r x 

=AP" 1 r ( ^ (4.23) 

We can prove the following generalizations of standard facts about electrical flow/effective resistance 
for multicommodity electrical flows. 

Fact 4.1 1. f satisfies the demands, that is T T J= d. 

2. £(P,~f) = d T C + d 

3. For any other flow f that satisfies the demands, £(P,f) > £(P,f). 

Proof 

Part 1 



r T f =Ar T pr<i 



=A£ T £ + d 
A 



=d 



(4.24) 
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Part 2 



£(P,f) =fpf 

=d T £+d(p- 1 r0) T p(p^ 1 r0) 
=d T £+d^ T r T P" 1 pp~ 1 r0 

=d T £ + d$ T £0 

=d T C + d Since '£(j> = 1 (4.25) 

Part 3 

Let f be any flow satisfying T T f = d. Then we have: 

£(P, f) >(f T Pf)(^ T r T P _1 r^) Due to the constraint T £0 < 1 
=||P 1 / 2 ^|2||p-i/2 r 0||2 

>(f T r^) 2 By Cauchy-Schwartz inequality 
={d T (f)) 2 Since f satisfies the demands 

=£(P,f) By Part 2 (4.26) 

■ 

4.2 Find Almost Optimal Vertex Potentials 

The main part of computing an almost optimal set of vertex potentials from 4.21 is the computation of 
C + d. Since P is no longer a diagonal, the matrix C is no longer a Laplacian matrix. However, in certain 
more restrictive cases that still suffice for our purposes we can use lemma 2.1 of [BHV04]: 

Lemma 4.2 For any matrices V,G,H, if H < G < kH, then VHV T <G < kVHV t . 

Proof Consider any vector x, we have: 

x T VHV T x = {V T x) T H(V T x) < (V T x) T G{V T x) = x T VGV T x (4.27) 

and 

x T VGV T x = (V T x) T G{V T x) 1 k(V t x) t H(V t x) = kx t VHV t x (4.28) 

■ 

This lemma allows us to precondition P when each of P(e) is well-conditioned, specifically: 

Lemma 4.3 If there exist a constant k such that for all e, KA m i n (P(e)) > A max (P(e)), then we can find a 
Laplacian matrix C such that C < C < kC. 

Proof Consider replacing P(e) with P(e) = A m j n (P(e))I(e) where 1(e) is the k - by - k identity matrix. 
Then since P(e) ^ A max I(e) as well, we have: 

P(e) 1 P(e) 1 X max (P(e))I(e) = ^g^ P( e ) (4.29) 

Amin(P(e)) 
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Then applying Lemma 4.2 with V = T , G = P and H = P gives: 



L<L<kL (4.30) 

■ 

The following fact then allows us to solve linear equations on C by solving linear systems on C instead: 

Lemma 4.4 (preconditioned Chebyshev) [Saa96, Axe94j Given matrix A, vector b, linear operator B and 
a constant k such that B < A + -< kB and a desired error tolerance 6. We can compute a vector x such 
that \ \x — A + b\\A < ^H^^IU using 0{\JTi\og 1/0) evaluations of the linear operators A and B. 

Note that due to V being k copies of the edge-vertex incidence matrix, the matrix L is actually k 
Laplacians arranged in block-diagonal form. This allows us to apply SDD linear system solves to apply an 
operator that is close to the pseudo-inverse of C, which we in turn use to solve systems involving C using 
Lemma 4.4. 

Lemma 4.5 [ST06, KMP10, KMP11] Given a Laplacian matrix of the form L = B T WB for some diag- 
onal matrix W > 0, there is a linear operator A such that 



A H L + ■< 2A 

And for any vector x, Ax can be evaluated in time 0{m) where m is the number of non-zero entries in 

L. 



We can now prove the main result about solving systems involving C. 

Lemma 4.6 Given any set of energy matrices on edges P such that X max (P(e)) < KX m i n (P(e)), a vector 
d and error parameter 5. We can find an almost optimal set of vertex potentials x such that: 

\\x-x\\c<5\\x\\ c (4.31) 

In time 0(mA: 2 v / KpoZy(e _1 )). 

Proof Applying Lemma 4.5 to each of the Laplacians that make up C, we can obtain a linear operator 
A such that: 

C + r< A ± 2C + (4.32) 

Such that Ax can be evaluated in time 0(mk). 
Combining these bounds then gives: 

A H 2£ + H 2kA (4.33) 

Then the running time follows from Lemma 4.4, which requires an extra k iterations, and the fact that 
a forward multiply involving P costs 0(mk 2 ). ■ 

Using this extension to the solver we can prove our main theorem about solving quadratically coupled 
flows, which we prove in Appendix A. 
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Theorem 4.7 There is an algorithm QuadraticCoupledFlow such that for any 5 > and F > 0, any 
set of energy matrices P(e) such that I ^ P(e) ^ U I for a parameter U and KA m i n (P(e)) > A max (P(e)), and 
any demand vector d such that the corresponding minimum energy flow is f, computes in time 0{(yfnk 2 + 
k u )m\og{U / 5)) a vector of vertex potentials cj> and a flow f such that 

1. f satisfies the demands in all the commodities T T f= d 

2. £ } {P)<{\ + 5)£j{P) 

3. for every edge e, £ e \\£f(P,e) - £~ f (P,e)\\ < 5£j{P) 

4- The energy given by the potentials £(P,<f>) is at most 1. and its objective, d T cf> is at least (1 — 

S)Ceff(P). 

5 Generalization of Maximum Flow to Quadratically Capacitated Flows 

We now show that we can repeatedly solve quadratically coupled flows inside a multiplicative weights rou- 
tine to minimize the maximum saturation of an edge. Pseudocode of our algorithm is shown in Algorithm 
1. 

The guarantees of this algorithm can be formalized as follows: 

Theorem 5.1 Given a graph G = (V,E) and energy matrices P(e) on each of the edges such that 
K\minP{e) > ^maxP(e) and a parameter e, QuadraticCapacitatedFlow returns one of the follow- 
ing in 0(mk 2 Ke~ 8 ^) time: 

• A k-commodity flow f such that saturationf(P, e) < 1 + lOe for all edges e and Tf= d. 

• fail indicating that there does not exist a k-commodity flow f that satisfies all demands and have 
saturationf(P, e) < 1 — e on all edges. 

We first state the following bounds regarding the overall sum of potentials , the weight of a single 
edge w^(e) and the effective conductance given by the reweighed energy matrices at each iteration, £(P^). 

Lemma 5.2 The following holds when f satisfies Y^ e saturation-^P^ 1 ^, e) < p^~^ . 
1, 

fj,® < exp /Z*- 1 ) (5.34) 

2. i»(*)(e) is non- decreasing in all iterations, and if saturation-^) (P^\e) < p, we have: 

c 



w (t) (e) > exp y- saturation.^) (P W ,e)J to (t_1 )(e) (5.35) 

3. If for some edge e we have saturation-^ (P,e) > p, then C e ff(P^) > C e f f{P^~ 1 ^) exp 

The proof of Lemma 5.2 relies on the following facts about exp(x) when x is close to 1: 
Fact 5.3 1. Ifx > 0, 1 + x < exp(x). 
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Algorithm 1 Multiplicative weights update routine for approximately solving quadratic capacitated flows 
QuadraticCapacitatedFlow 

Input: Weighted graph G = (V,E,w), energy matrix P(e) for each edge e, demands di . . . d& for each 
commodity. Error bound e. 

Output: Either a collection of flows f such that saturatiorif(P, e) < 1 + e, or FAIL indicating that there 
does not exist a solution f where saturationf(P, e) < 1 — 2e. 

1: p «- 10m 1 / 3 e _2/3 

2: A i- 20plnme~ 2 = 200m 1 / 3 lnrae~ 8/3 
3: Initialize w(°) (e) = 1 for all e £ E 
4: f «- 
5: Ni <- 

6: for t = 1 ... A do 

7: Compute ^C* -1 ) = E e w(t_1) ( e ) 

8: Compute reweighed energy matrices, p( i_1 )(e) = {w^~ l \e) + ^P^ 1 ^) P(e) 

9: Query QuadraticCoupledFlow with energy matrices p(* _1 )(e) and error bound 5 = — , let the 
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flow returned be f' 

if £j(t)(P (t-1) ) > p {t ~ 1] then 

return fail 
else 

if saturation-(t) (P^ _1 \ e) < p for all e then 

f<-f+f® ' 
Ai <- Ai + 1 
end if 
for e £ i? do 

wW(e) <- w( i ~ 1 )(e) (l + ^saturations (P ( ' _1) ,e; 
end for 
end if 
end for 
return -^-f 



2. If0<x<e, then 1 + x > exp((l - e)x). 

Proof of Part 1 : 

pit) =^wW(e) 

e 

= ^2 w ( - i ~ 1 - l (e)(l + -saturation^) (P, e)) By the update rule 



^V* -1 ^ +- p ^w^- 1 )(e)saturation fW (P,e)^ 



<//* ^ H — pP ^ By definition of p& ^ and asumption about total weighted saturation 
P 

= (1 + -)p {t ~ l) < exp(-)/x ( *- 1) By Fact 5.3.1 (5.36) 
P P 
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■ (Part 1) 

Proof of Part 2: 

If saturation^) (P",e) < p, then ^saturation-( t )(P^\ e) < e and: 

w W(e) = w (*- 1 )(e) ( 1 + -saturations (pW,e 

V p f 

<w (t ~ 1) (e)exp ( -^—^ ^ saturationf(P,e)^ By Fact 5.3.2 (5.37) 

■ (Part 2) 

Proof of Part 3: 

Let e be the edge where saturationj,(P, e) > p, then since P^ _1 ^(e) >z —p>I by line 8, we have: 

saturation7.(P ( ' _1) ,e) 2 >— u (t_1) o 2 

3m 

ep 2 

> £(p(* -1 ),f) By assumption of the energy of the flow returned (5.38) 

3m 

Invoking the guarantees proven in Theorem 4.7, we have: 

saturation f (P ( * _1) ,e) 2 >saturationj(P ( ' _1) , e) 2 - |saturation f (P ( * _1) , e) 2 - saturation^*" 1 ), e) 2 

^saturation^P^" 1 ^) 2 - <J£(p( t_1 )) By Part 3 
eo 2 

>TT^^t)(P (<_1) )) " ^(P (< " 1} ) By Equation 5.38 
3m 

> ^TZ^ g(P (f " 1} ) " ^(P (t_1) ) By Part 2 
3(1 + ojm 

>££_£(p(*-i)) (5.39) 
4m 

Then by the relation between (p and f, we have that 

^ (t _ 1) (p('- 1 )(e)) >^ (t _ 1)(P (^)) (5.40) 
Then since w^)(e) > (1 + e)w^~ 1 )(e), using the current set of optimal potential gives: 

^ (t -i)(p (i) ) <(i - ^W^U) (5.4i) 



Which means that when e < 0.01, J 1 + is a valid set of potentials for P^ and therefore: 
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c e//( pW)>(d^i + ^-^ 
> exp (£^) (d T 0(*- 1 )) 2 

\ 5m / 

= exp(^)c e// (P (t " 1) ) (5.42) 

■ (Part 3) 

Proof of Theorem 5.1: 

Since ^ e (u;( t_1 )(e) + ^/i^~ 1 ^) = (l+e)//* -1 ), if there exist a flow f such that saturatiorif(P, e) < 1 — 2e 
for all e, we have that £^t)(P) < (1 — e)^* -1 ). Then if the algorithm does not return fail, Theorem 4.7 

means that ^ satisfies: 

% t) <(l + S)(l-e)^ 

<^-V (5.43) 

^w( t - 1 )(e)saturation-( t) (p( i - 1 \e) 2 <^w( t " 1 )(e) (5.44) 

e e 

Multiplying both sides by /U^ t_1 ^ and applying the Cauchy- Schwartz inequality gives: 

(E w(t-1) ( e )) ^ (E w(t_1) ( e )) ^E w( *" 1) ( e ) saturatio v ) ( p(t ~ 1) ' e ) 2 ) 

> ^^w(*~ 1 )(e)saturation- (f) (p(*~ 1 \e)^ (5.45) 
Taking the square root of both sides gives: 

w (t_1) (e)saturation f( *) (P^ 1 ) , e) <// ( * _1) (5.46) 

e 

Therefore inductively applying Lemma 5.2 Parti, we have: 

/ \ N 

w <„.(°) . / 



exp(- 
V P 

feN\ 
= exp m 

VP/ 
/211n?n\ 

< exp ( — J (5.47) 

We now bound N', the number of iterations t where there is an edge with saturation^) (p(*~ ^ , e) > p. 
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Suppose C e fj(P^) < 1/2, then in the flow returned, no edge e has saturation-^) (P , e) > 1, which means 
that the algorithm can already return that flow. 

Then by the monotonicity of C e ff(P^) and Lemma 5.2 Part 3, we have: 

C e// ( P W)>l/2.exp(^) (5.48) 



Combining this with 



(5.49) 



gives: 



e 2 p 2 N' 211nm 
5m ~~ e 



, ^ 105m In m 

— p2 £ 3 

<eN (5.50) 

Then in all the N — N' > (1 — e)N iterations, we have saturation^) (P^ _1 \ e) < p for all edges e. 
Then we have: 

saturation ~( t )(P,e) < > saturation-^) (P, e) Since P(e) defines a norm 

/ ,+ I ' 



< log(^ (t) )/(-) By Lemma 5.2 Part 2 

=^^T' < (1 + 2e)T' (5.51) 



6 Algorithm for Maximum Concurrent Multicommodity Flow 

One of the main difficulties in directly applying the flow algorithm from [CKM + 11] is that single commodity 
congestion constraints of the form ||f(e)||i < u e are 'sharper' than the L<i energy functions due to the sign 
changes when each of the commodities are around 0. 

As a result, we use the primal Primal-Dual SDP algorithm from [AK07] to generate the energy matrix. 
Pseudocode of the outermost layer of our algorithm for maximum concurrent flow is shown in Algorithm 
2. 

Where the update routine, UPDATE is shown in Algorithm 3. Note that Xi indicates the matrix that's 
1 in entry and everywhere else, and is used to store the sum of M^') over 1 < r < t to we do 
not need to pass all of them to each invocation of Update. 

We start off by bounding the condition number of P^(e). 

Lemma 6.1 

\ max {P (t) {e)) < 2ke- 1 \ mm (pV(e)) 
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Algorithm 2 Algorithm for minimizing L\ congestion 



MaxConcurrentFlow 

Input: Capacitated graph G = (V, E, u) and demands d. 

Algorithm for computing energy matrices based on a list of k flows, Energy and for minimizing the 
maximum energy along an edge. Iteration count N and error tolerance e. 

Output: Either a flow f that meets the demands and | |f(e)| |i < (1 + 10e)/x(e) on all edges, or fail indicating 
that there does not exist a flow f that meets the demands and satisfy ||f(e)||i < /i(e) on all edges. 

1: p •<— \fke~ 1 

6 _ e 1 / 2 
2: 61 ~k~p ~ W 2 " 

3: e[ i ln(l - ei) 

4: N i- pe'f 2 log k = k 7 / 2 e~ 3 / 2 log k 
5: Initialize M°(e) = 0, W°(e) = I 
6: for t = 1 ... N do 
7: for e £ £ do 

8: P(*~ 1 )(e) = £ (w(*- 1 )(e)/||W(*- 1 )|| 00 
9: end for 

10: Query QuadraticCapacitatedFlow with matrix p(* _1 ) 
11: if QuadraticCapacitatedFlow returns fail then 
12: return fail 
13: else 

14: Let the flow returned be r 
15: for e G E do 

16: (M (t) (e),W(''(e)) <- Update(M ( * _1) (e), W(*- 1 )(e),f W ) 

17: end for 
18: end if 
19: end for 

20: return ^ Et=i f W 



Proof Since W(e) is positive semi definite, we have P^(e) y el. Also, by definition of i^\e), we have 
that the maximum diagonal entry of W (i ~ 1) (e)/||W (i ~ 1) (e)|| 00 is 1. Therefore tr(P (i) (e)) < fe+tr(el) < 2k. 
This in turn implies X max (P (t) (e)) < 2k, which gives the required result. ■ 

We first show that when a flow exist, QuadraticCapacitatedFlow returns a flow i (e) with low 
energy on each edge. 

Lemma 6.2 If there is f such that |/(e)|i < 1, then at each iteration t we have E-jt) (P ( - t ~ 1 \ e) < 1 + 2e. 
Proof 
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Algorithm 3 Matrix exponential based algorithm for generating energy matrix 



Update 

Input: M ( * _1) (e) , W ( * _1) (e) from previous iterations, flow from iteration t, f (e), Capacity u(e), Parameter 
A- 

Output: Sum matrix from current iteration S, Energy matrix X. 
1: Find i^~ l \e) = argmaxj W>* ^(e) 

2: M^(e) <- ((l + 2e)xi(t-i) (e ) - ^f (i) (e)(f (i) (e)) T + pi) /2p where x % is the matrix with 1 in 

and everywhere else 
3: M (t) (e) ^M (< " 1) (e) + MW(e) 
4: W< f '(e) = exp(-e' 1 M (t) (e)) 
5: return (M W (e), W^(e)) 



Therefore we have: 



<%) (W (t ~ !) (e)) =f(e) T W ( *- 1)(e) f 

< 5 |ft(e)||f i (e)||wg- 1 >(e)| 

ij 

=l|w(*- 1 )|U (Eiwi) 

<||W(*- I )(e)|| 00 u(e) 2 (6.52) 

I FTT^ %)(W ( '" 1)(e) ) +£ f(e) (el)) | 

u(e) 2 vJlW^^IU f(e)V f(e)V ; 7 

<l + 2e (6.53) 
Since £- f(e) (eI)) = e\\f(e)\\l < e\\t(e)\\l < u («) 2 . 

And the properties of f^(e) follows from the guarantees of Theorem 5.1. ■ 
Using this width bound, we can now adapt the analysis in [AK07] to show that the sum of flows can 
be bounded in the matrix sense. 

Lemma 6.3 If in all iterations the flows returned satisfy f- t \e){f^ {e)) T ■< pu 2 I, then we have the follow- 
ing by the end of N iterations: 



^ t )(p^, e )< 
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Proof 

The proof is similar to the proofs of Theorems 10 and 1 in Section 6 of [AK07]. We have: 



tr(w®(e)) =tr I exp(-ei ^M«(e)) 



r=0 

/ (*-l) 

<tr exp(-e' 1 ^ M (r) (e)) exp(-e' 1 M w (e)) I By Golden-Thompson inequality 

\ r=0 

= tr (W^" 1 ) (e) exp(-e' 1 MW (e)) ' 

<tr (w(* -1) (e)(I - eiMW(e))j Since exp(-e' 1 A) r< (I - e^A) when ^ A ^ I 
= tr(W( i - 1 )(e)) -eitr(W(*- 1 )(e)MW) (6.54) 

The construction of W(e) from line 4 of UPDATE means that W(e) is positive semi-definite. This in 
turn implies that ||W(e)||oo < maxj Wjj. Substituting gives: 



tr W( w '(e)MW(e) 
= tr (W^W • ((1 + 2e) Xl ^ - fW«(fW( e )) T + pi) /2p) 

~ ((1 + 2£)||W(*- 1 )( e )|| 00 - -l^(f(*)( e ))^w(*- 1 )( e )f<*)( e )") + I tr(W('- 1 )(e)) 

<1 ((1 + 2 e )||W('- 1 )(e)|| 00 - ||W(*- 1 )( e )|| 0O (f<*)( e )) T p(*- 1 )( e )i<*)(e)) + \ trfW^^e)) 

Since w(t-1) ( £ ) < P<t-V(e) 

>^tr(W ( *" 1) (e)) By Lemma 6.2 (6.55) 
Combining these two gives: 

tr (exp(-eiM (Ar) (e))) =tr(W N (e)) 

-y 

ei 
V 2 

< exp (- Q ~^ €l N^j Since N = lOpe'f 2 log A; (6.56) 
Using the fact that exp(— A max (A)) < tr(— exp(A)), we get: 



</cexp (- — N 
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(1 -ex)e l m ^^ M(t)(e) 

=e[ £ (1 + 2e) Xi (.) - -^f«(e)(f«(e)) T +pl) /2p 
-e' lP NI + " ^(eXrf'W 

-i fE^( e )(^(e)) T> ) ^(l + 2e )X; x#) + e ' 1 pAri 



(6.57) 
(6.58) 
(6.59) 



\t=i / t=o 

Substituting in the setting of e± = gives the desired result. 

■ 

This in turns lets us bound the L\ congestion of the flow returned after T iterations. 

Theorem 6.4 After N = 0(/c 7 / 2 e~ 5 / 2 log k) iterations, MaxConcurrentFlow returns a flow f where 
for each edge e, we have: 



1 N 

N 



< (1 + 3e)« 



Proof 

We first bound the width of each update step. Note that by construction we have: 

-(fW(e)) T If«(e) <(l + e) 



u 2 k 

\(^\e)) T I^(e)<2ke- 1 



u- 



(6.60) 
(6.61) 



Then by the Cauchy-Schwartz inequality we have: 



u(e) 



<k 



fW| 



--2ke 



u(e) 

-i 



(6.62) 



Which gives that p = V2ke 1 suffices as width parameter. 

Let s be the vector corresponding to the signs of the entries of E^f^e), aka. s T E?=i ^ ( e ) 
Then: 
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Kt<N 



He^'m) 

^ t=l / 



, iV 2 

< — ^ (s T f^ (e)) By Cauchy-Schwartz 
t=i 

1 f N N \ 

% sT (E( 1 + 2e )^) + x i)s B y 



Lemma 6.3 

=1 + 3e Since Sj = ±1 and s T s = k (6.63) 

■ 

The running time of the algorithm can then be bounded as follows: 

Lemma 6.5 Each iteration of the MaxConcurrentFlow runs in giving 
an overall running time ofd(m^ 3 k 6 e~ 17 / 3 + mk 7 / 2+UJ e~^ 2 ), where lo is the matrix multiplication exponent. 

Proof The first term follows from the running time of QuadraticCapacitatedFlow proven in Theo- 
rem 5.1 and «;(P(e)) < 0(V Zee -1 ) from Lemma 6.1. For the second term, the bottleneck is the computation 
of matrix exponentials. This can be done in poly (log matrix multiplies using [YL93], giving the 0(k u) ) 
bound in the each of the iterations. ■ 

7 Alternative Outer Algorithm 

We show a modified formulation of the capacity bounds as 2 k constraints per edge that brings us back 
to minimizing the maximum congestion. This gives a more combinatorial approach to minimizing the 
maximum L\ congestion, although the algorithm is slightly more intricate. As the computation of energy 
matrices only rely on the sum of flows so far (aka. history independent), we describe its computation in a 
separate routine ENERGY and first state the overall algorithm in Algorithm 4. 

We start with the following observation that the maximum among the sums given by all 2 k choices of 
signs to fj(e) equals congestion. 



Observation 7.1 



J2\fi(e)\= max Vs^(e) 



We let S to denote the set of all 2 k settings of signs. This allows us to reformulate the constraint of 
||f( e )||i<u(e) as: 



s T f(e) < u(e) Vs G S (7.64) 
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Algorithm 4 Alternate Algorithm for Maximum Concurrent Multicommodity Flow 



MaxConcurrentFlowI 

Input: Capacitated graph G = (V, E, u) and demands d. 

Algorithm for computing energy matrices based on a list of k flows, Energy and for minimizing the 
maximum energy along an edge, QuadraticallyCapacitatedFlow. Width parameter p, iteration 
count N and error tolerance e. 

Output: Either a flow f that meets the demands and | |f(e)| |i < (1 + We)p(e) on all edges, or fail indicating 
that there does not exist a flow f that meets the demands and satisfy ||f(e)||i < p(e) on all edges. 

l: for t = 1 ... N do 

2: for e££ do 

3: pW(e)=ENERGY(E 1 < r<t f (r) (e)) 

4: end for 

5: Query QuadraticCapacitatedFlow with matrix 

6: if QuadraticCapacitatedFlow returns fail then 

7: return fail 

8: end if 

9: end for 

10: return i Y%=i ^ 



This reduces the problem back to minimizing the maximum among all \S\ = 2 k dot products with 
f(e). To solve this problem we can once again apply the multiplicative weights framework. We state the 
convergence result in a more general form: 

Theorem 7.2 If for all flows /(e), ENERGY(/(e) ) returns a matrix 



P(e) 



(7.65) 



Where w(s) satisfies 



exp ( f£/W) <y, [s) < (1 + £ ) exp ( f^JW) (7.66) 

Then: 

1. Xmax(P{e)) <2ke- 1 X mm (P{e))- 

2. If there exist a flow J that meets all the demands and have ||/(e)||i < (1— 2>e)u(e), MaxConcurrentFlow 
with p = k and N = pke~ 2 returns a flow f that meets the demands and satisfy ||/(e)||i < (l + 3e)u(e) 
over all edges. 

Proof of Part 1 : 

For A m i n (P(e)), we have P(e) ^ and the condition number bound follows from \ m i n (I) = 1. 

We can bound the maximum eigenvalue with the trance. Note that tr(ss T ) = k since the diagonal of 
ss T is all 1. This gives: 
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A ma *(P(e)) <tr(P(e)) 



Therefore we get: 



w(e) J T 



ue) 



trl 



1 + e 



u e 



A max (P(e)) 1 + e _! 
A mi „(P(e)) -u(e) 2 6 
<2/ce _1 



(7.67) 



(7.68) 



Proof o/ Pari 2; 

We define the exact set of weights that w(s) are trying to approximate: 



We also let *W = E S& S W ( S ) W - 
We have that at any iteration: 



w 



(s)W 



es 
exp - 



P u(e) 



>maxw(s)(*) 

s 

= exp (max f^) 

s 

= exp(||f%) 



(7.69) 



(7.70) 
(7.71) 



Therefore it suffices to upper bound the value of /i^. First note that if there is a flow f such that 
||f(e)||i < (1 — 3e)u(e), then we have s T f(e) < ||f(e)||i < u(e) for any s Squaring this and taking sum over 
all s G S gives: 



f(e) T P(e)( t - 1) f(e) =f(e) 



E. e5 w(s)(*-i)^ u(e) 



E 



ss^ + 



ku(e) 



^w( S )(*- 



1) 



se5 



s T f(e) 



u(e) 



+ e 



i(e) 



u e 



< 



: E se5 w(s)(*-D 
<(l-2e) 2 



(l-3e) 2 ^w(s) ( ' -1) +e 
se<s 



(7.72) 



This means that there exist a flow f such that saturationf(p(* 1 \ e) < 1 — 2e. Therefore by Theorem 
5.1, we have that saturation-^) (P^ -1 **, e) < 1 — e for all edges. This has two consequences: 
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1. 



u(e) 



€ —({ {t) ) T If {t) <1 - e Since P(e) >z ^1 



u(e) 



_* 
e 



u(e) 



By Cauchy Schwartz inequality 



(7.73) 



iCO, 



Squaring both sides gives that u (e) < V^e x ^ 2 , which allows us to bound the width of the multi- 
plicative updates. 

2. Expanding out the first term in the formulation of P(e) gives: 



ses \ w / sg5 



(t-i) 



(7.74) 



Multiplying both sides by S s g5^( s )^ X ^ anc ^ a PPlying Cauchy-Schwartz inequality gives: 



se<s 



(t-i) 



s w(e) 



u e 



<E4) H) 
ses 



(7.75) 



Combining with the fact that w < w < (1 + e)w gives: 



]Tw ( s)^ 

ses 



s T w(e) 



u(e) 



<(l + e) ^ w(s )(*-D 
ses 



(7.76) 



Using Fact 5.3 we have: 
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ts VP u(e) J 

<^w(s)^)e X p(- e S ^ (e) 
ses ^' 



e 



(t-i) 



1) (1 + 26)6 



s w(e) 



u(e) 



<-(l + 2e)(l + e)V w(s)(*- 1 ) 
P 

< !M w(M) 



< 



exp( 



,e(l+_4e) 



w 



(t-l) 



Since exp(x) is monotonic and x < |x| 



By Fact 5.3 Part 2 and 



s T w(e) 



By Fact 5.3 Part 1 



Applying this inductively along with the fact that w° = 2 k gives: 



(7.77) 



Substituting in N = ^| gives: 



w<<><2'exp(^i±^)' 
' E (l + 4e)t , , 



■ exp 



< exp 



: exp 



Which gives i | (e) 1 1 < (1 + e)u(e). 



e(l + Ae)pk 

pe 2 
(l + 5e)Jfe 



+ k 



: exp ( ~(l + 5e J AO 



(7.78) 



(7.79) 



7.1 Efficient Estimation of the Energy Matrix 

The algorithm as stated has an iteration complexity that's 0(/c 3 / 2 e~ 5//2 ), which is small enough for our 
purposes. 

However, a direct implementation of the generation of the energy matrix P(e) requires looping through 
each of the 2 k sign vectors s 6 S and computing s T f, which takes time exponential in k. 

To alleviate this problem, note that the requirement of Theorem 7.2 allows us to compute the matrix 
for some set of weights w where w(s) < w < (1 + e)w(s). Specifically we show the following: 

Theorem 7.3 Given a flow f such that \ \j\\i < p'u, there is an algorithm Energy that computes a matrix 
P where 
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P = Y^ wss T (7.80) 
( — "\ <w< (l + e)expf— \ (7.81) 



In 0(k p'e ) time. 



Since we have the signs of each of the f,, we can easily find the value s that maximizes s T f. We let this 
set of signs be s, then we have for all s € S: 

fs T (\ /S T f\ / (s-s) T f\ , , 

exp {— ) = exp (- ) exp (-^- ) (7.82) 

The first term is a constant, therefore it suffices to get good approximations for the second term. To 
do so we round each entry of f to the lowest integral multiple of 4 and bound the error as follows: 

Lemma 7.4 Let f be f with each entry rounded towards to the nearest multiple of ^u. Then we have: 
( (s-s) T f\ ( (s-s) T ~f\ , , / (s-s) T f\ , , 

Also, 1 1/| 1 1 < p'u as well. 

Proof of Theorem 7.3: Note that by the choice of s, Sjf, > in each of commodity i. Therefore 
(s — s)jfj is either or 2fj. By the rounding rule we have: 

|fi| - <|f,| < |fi| (7.84) 

Which gives us the bound on ||f||i. When combined with the fact that fj having the same sign as f, 
gives: 

(s - s)ifi - <(s - sjifj < (s - s)ifi (7.85) 
Summing this over the k commodities gives: 



(s - s) T f - — u <(s - s) T f < (s - s) T f (7.86) 
3 

Exponentiating both sides of Fact 5.3 Part 2 gives exp(^) < (1 + e), from which the result follows. ■ 
After this rounding, the values of s T f can only be multiples of |u between [—p'u, p'u]. This allows 
us to narrow down the number of possible values of exp(^j-) to one of O(p'ke-l) values. Further more, 
notice that to calculate it suffices to find the list of values of =— - among all s such that Sj = Sj and the 
list where Sj ^ sj. Each of these calculations can be done in O( / / /c 2 e~ 1 ) time using the following lemma: 
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Lemma 7.5 Given a list of positive integer values ai,a^, ■ ■ ■ dk such that a% = iV, i/tere is an al- 
gorithm ConvolveAll that computes in 0(Nk log 2 N) time for each j € [1,N] the number of subsets 
S C {1, 2, ... k} such that J2ies ai = 3- 

Proof Since the ordering is irrelevant, we may assume that ai < < . . . ay.. Then there exist an index 
i such that Yli<j<i a j an< ^ Yli+x<j<k-x a 3 are both at most N/2. Suppose we have two lists containing 
the number of sums for each value between and N/2, then taking their convolution can be done in 
0(N log N) multiplications involving k bit numbers. The last entry of can be dealt with similarly. Let 
the time required to compute the answer when the total sum is N be T(N), then this gives the following 
recurrence: 

T(N) < 2T(A/2) + 0(Nk log N) (7.87) 

Solving gives T(N) = 0(Nk log 2 N). U 

Algorithm 5 Algorithm for computing approximate energy matrix 
Energy 

Input: A k commodity flow f. Capacity u, parameter p' such that ||f||i < p'u. Error bound e. 
Output: Approximate energy matrix satisfying the guarantees of Theorem 7.3 



l 

2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 



Compute the set of signs that maximizes s T f, s 
for i = 1 . . . k do 
if fj > then 

else 

f^-ufL-f^J 

end if 
end for 

for i = 1 ... k do 
for j = 1 ... k do 

for Each setting of Sj, Sj do 
for Each I ^ i,j do 

Create a t = 2^/ce -1 
end for 

b ^— Convolve ALL(a) 

for -p'ke^ 1 < I < p'ke" 1 do 

Pij «- Pij + b r Si ■ sj • exp(^^ - I) 
end for 
end for 
end for 
end for 
return P 



The overall pseudocode for computing this energy matrix is shown in Algorithm 5. Summing over all 
0(k 2 ) entries gives the total running time. It's worth noting that because the matrix entries consists of 
differences of weights, the matrix that we obtain can have some entries that are very different than what 
we would obtain if we use the exact values of w(s). Their similarity is obtained through the similarity of 
w and w as they are weights on positive semi-definite outer products. 
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We can now bound the overall running time of the algorithm: 

Corollary 7.6 MaxConcurrentFlowI runs in 0(/c 3//2 e~ 5//2 ) iterations, where each iteration takes time 

running time of ' 0(m 4 / 3 fc 4 e 1 ' i ? / 3 + m/c 13 / 2 e 4 ). 

Proof The iteration count from 7.2 completes the proof. The first term follows from Theorem 5.1 and 
«(P(e)) < Vke~ 1/2 , Theorem 7.2 Part 2 gives that ||fW||i < O(N), which gives ||^||i < ^ = 0(k). 
Letting p' = 0(k) in Theorem 7.3 then gives the second term in the bound. ■ 

8 Comments/Extensions 

We have shown an approach of dealing with the coupling of the k commodities by associating an energy 
matrix with them. This allows us to approximate multicommodity flows in time O(m 4 / 3 poly(/c, e^ 1 )). 
We believe that our approach is quite general and extends naturally to other couplings between sets of 
k flows/vertex labels, with the most natural generalization being Markov random fields [KS80, SZS + 08]. 
We believe that the strongest result along this direction would be an approximation of minimum cost 
flow that runs in O(m 4 / 3 poly(/c, e _1 ) time. Such a bound would imply an approximate multicommodity 
flow algorithm in (5(m 4 / 3 poly(A;, e -1 )) time as well [LMP + 91], although we believe a more intricate set of 
energy matrices might be a reasonable approach in this direction. 

When viewed from the point of combinatorial preconditioning, the method by which we were able to 
solve multicommodity electrical flows is based on modifying the conditioning number by adding e slack to 
the edges. For the purpose of obtaining lie approximations to combinatorial problems, this does not 
modify the solution by too much. However, this modification makes the condition number of the matrix 
with a Laplacian poly(A;, e^ 1 ), leading to the time bound for computing electrical multicommodity flows. 
It's unlikely that this approach can be used when we want algorithms whose dependency on e is 0(log(l/e)), 
as very little slack can be added onto the edges. It's also not clear to us whether the matrices obtained 
in such cases are better or worse behaved than general stiffness matrices. We believe that obtaining faster 
algorithms for such matrices is an interesting open problem. 
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Algorithm 6 Algorithm for computing near-optimal electrical potential/flow pair 



QuadraticCoupledFlow 

Input: Graph G = (V,E) with corresponding edge-vertex incidence matrix B. Demand vector d Energy 
matrices for the edges P along with bounds U, n such that / X P X U • I and A max (P(e)) X «;A m i n (P(e)). 
Error bound 5. 

Output: Approximate vertex potentials <f> and flow f that satisfies the constraints of Theorem 

1: Let C be an implicit representation of the matrix TPr 

2: Use PreconCheby to find x = C + d with error of e = ^^^4 

3: A <— Vx T £x 

4: 4> = J* 

5: Compute ohmic flow f = P _1 Tx 
6: for i = 1 . . . k do 

7: fj <- MAKEKlRCHHOFF(G, dj, fj) 

8: end for 

9: return <f>, f 
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Algorithm 7 Algorithm for making an arbitrary flow Krichoff 
MakeKirchhoff 

Input: Graph G = (W C V, E) with demands d. A Ohmic flow f. 
Output: A flow that satisfies conservation of flow at all vertices in W 

1: f <- f 

2: Pick any vertex r 

3: compute a spanning tree, T 

4: for each vertex u ^ r do 

5: route d n — (Tf) u units of flow from u to r along T 
6: end for 
7: return f 



A Obtaining Almost Optimal Electrical Flow from Potentials 

This approximate solve then allows us to compute electrical flows in a way analogous to theorem 2.3 of 
[CKM+11]. Pseudocode of the algorithm is shown in Algorithm 6. 

The algorithm makes calls to MakeKirchoff, which converts a flow f that doesn't satisfy conservation 
of flow at vertices in W to one that does without too much increase in congestion. Its properties are proven 
in Lemma A.l. 

We start by bounding the errors incurred by MakeKirchhoff 

Lemma A.l Given a capacitated graph G = (V, E,u), a set of demands d a flow f such that \ \T T j\\ oc < 7. 
MakeKirchhoff^, d, f) returns a flow f such that: 

1. T T ~f= d. 

2. For all edges e G E, \\f e — f e \\oo < mj. 

Proof Part 1 follows from the construction for each vertex u 7^ r and l T d = 0. To bound the extra 
congestion, note that each edge in the tree is used in at most n < m paths that route at most 7 units of 
flow each. This gives an extra congestion of at most rwy and therefore Part 2. ■ 

Proof of Theorem 4 • 7: 

We start off by showing that A does not differ by much from A = \/ 4> T C(f>: 

Lemma A. 2 

|A- A| <eA 

Proof 

1^ - ^1 =ll|x|U - \\x-Wc 

<||x — x||£ Since II • ||£ is a norm 

<e||x|| £ = eA (1.88) 

■ (Lemma A. 2) 

Algebraic manipulations of this gives: 
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Corollary A. 3 



(l-e)A <A < (l + e)A 
(l_2e)>4<(l + 2 £ )l 

This enables us to show that f = AP^Tx does not differ from f = AP~ 1 Tx by too much: 
Lemma A. 4 



(1.89) 
(1.90) 



\\f-l\\p<^(f-f) T P(f-f) 
<4eA 2 
=Ae£j(P) 



(1.91) 



Proof 



If-fll 



=||p- 1 rx-p^ 1 rx|| P 

= ||x — x)||£ By definition of £ 

< e \\*\\c 



(1.92) 
(1.93) 

■ (Lemma A. 4) 

This in turn gives bounds on the maximum entry-difference of f and f: 
Corollary A. 5 

||/-^U<eA 

Proof Follows from P ^ I and 1 1 v| |oo < || v l|2 for any vector v. ■(Corollary A. 5) 

Since f meets the demands at each vertex, the among that f does not meet the demand by is at most 
emkX. Then Lemma A.l gives that this bound is amplified to at most em 2 k 2 X. The following two bounds 
are immediate consequences of this: 



1. 



|f-f||p <||f-f||p + ||f-f||p 



<eUm 2 k 2 X + eA 
<2eU 2 m 2 k 2 X 



Since P -< Ul 



(1.94) 



2. 



^(P)- A /£-f(P)=||f||p-||f|| pC ? 

<||f - f||p < 2eU 2 m 2 k 2 X 



(1.95) 



Which in turn implies that 



ff(P) <(1 + 5eU 2 m 2 k 2 )j£- f (P) 



28 



When eU 2 m 2 k 2 < 0.01. 



This allows us to obtain the overall bound for the L2 energy difference of the two flows: 



£|£ f (P, e )-5 f (P,e) 




||f(e) + f(e)||p( e ) J by Cauchy-Schwartz inequality 

since (a + b) 2 < 2{a 2 + b 2 ) and £j(P) < £ f (P) 
< ((1 + 5eU 2 m 2 k 2 )X) (5eU 2 m 2 k 2 X) by bounds listed above 

<10eU 2 m 2 k 2 £- f (P) When 5eU 2 m 2 k 2 < 1 (1.96) 

It can be checked that when 5 < 0.1, setting e = 2m*k' i u ^ or ^ e con dition as well as bounding the last 
term by 5. For this setting, we have log(l/e) < 0(log(Umk/8)). 
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